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Abstract 

The  problem  of  optinun  data  quantization  for 
memoryless  signal-detection  systems  operating  in 
ffl-depcndent  noise  environments  is  considered. 

The  case  where  quantizer  breakpoints  are  fixed 
or  predetermined  is  considered  first,  and,  for 
this  case,  existing  results  for  general  (un- 
quantized) memorylcss  detection  are  modified  to 
yield  necessary  and  sufficient  conditions  for 
quantizer  optimization  in  terms  of  asymptotic 
efficiency.  Necessary  conditions  are  also  estab- 
lished for  the  optimum  (asysipcotically  efficient) 
selection  of  quantizer  breakpoints,  and  expres- 
sions are  presented  for  the  comparison  of 
quancizer-decector  performance  on  the  basis  of 
asymptotic  relative  efficiency.  


1.  Introduction 

Signal  detection  systems  frequently  Involve 
memoryless  nonlinear  operations  on  input  data, 
and  there  are  a number  of  practical  advantages 
to  replacing  these  detection  nonlinearities 
with  quantizers.  Several  authors  have  considered 
the  problem  of  optimally  designing  quantizers 
for  this  purpose,  and  design  criteria  have  been 
developed  for  quantizers  to  be  used  in  a variety 
of  signal  and  noise  situations  [1- 3 ] . Many  of 
these  previous  studies  ace  based  primarily  on 
Che  assumption  of  independent  sampling,  and  it 
is  Che  purpose  of  this  paper  to  extend  some  of 
these  previous  results  to  the  case  where  there 
is  dependence  among  the  observed  data  samples. 

To  study  this  problem  we  consider  the  large- 
sample-size  case  of  detecting  known  constant 
signals  in  additive  noise,  and  model  the  depend- 
ence structure  by  assuming  chat  Che  noise  process 
is  a-dependenc.  In  general,  an  optimal  detection 
procedure  for  this  situation  will  require  a 
memory  of  length  m;  however,  we  will  restrict  our 
study  Co  those  detectors  which  may  be  imple- 
mented without  memory.  The  design  of  general 
(unquanc Ized ) memoryless  detectors  for  this  situ- 
ation hat  been  considered  in  [ 4 ] and  here  we 
apply  Che  techniques  of  this  earlier  study  to  the 
corresponding  quantizer  design  problem. 

In  Section  2 we  state  more  precisely  the 
problem  to  be  considered  and  review  previous 
pertinent  results  concerning  general  memoryless 
detection  from  [4  ] and  opcisrsm  quantization 
from  I 1 ].  Section  3 includes  the  derivation 
of  design  aquations  for  opcimum  quantizer  design 
for  Che  case  where  Che  breakpoints  are  fixed,  as 
wall  as  optimization  for  the  general  quantizer  case; 
and  expressions  are  presented  here  for  the  com- 
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parison  of  daceccor  performance  for  large  sanple 
sizes.  In  Section  4,  four-level  quantization  is 
considered  in  detail  for  two  particular  m-de- 
pendanc  noise  processes,  and  the  performance 
of  resulting  quantizer  designs  is  compared  to 
that  of  previous  designs  for  the  corresponding 
case  where  independence  was  assumed. 

2.  Praliminarles 

2.1.  Problem  Statement  and  Assimiptioos 

As  noted  above,  we  consider  Che  decaccion 
of  a known  constant  signal  in  additive  m-depend- 
enc  noise.  Specifically,  we  assume  Chat  %«a  have 
a sequence  x • (x^;  i>l,...,a}  of  real  observa- 
tions of  a process  X • [X^;  i>l,...,n};  and,  on 
Che  basis  of  x,  we  wish  to  decide  between  the 
following  pair  of  hypotheses  concerning  X; 
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where  ^ zero-mean  second-order- sta- 

tionary m-dependenc  noise  process  and  6 is  a 
known  positive  constant  signal.  By  m-dependenc, 
we  mean  that  there  is  an  integer  m such  that  Che 
sequences  {n,,  i-1,...,;}  and  (n^;  i»5,....*l 
are  independent  whenever  ? - C >m’'  [note  chat 
n>0  gives  an  independent  process].  He  will 
assume  throughout  chat  f,  the  common  univariate 
probability  density  of  the  noise  sequence,  is 
symmetric,  continuously  differentiable,  and 
strictly  positive  on  the  entire  real  line.  Our 
study  is  restricted  to  the  asymptotic  (large- 
sample-slze)  case  and,  Co  avoid  singularity,  we 
will  consider  the  local  or  small-signal  limit. 

2.2.  Optimum  Memoryless  Detection 

In  [4],  the  design  of  opcimum  memoryless 
detectors  for  Che  problem  of  Eq.  (1)  is  con- 
sidered. Because  techniques  similar  to  those  of 
[4  ] will  be  applied  in  this  study,  Che  results 
of  [4  1 are  summarized  here. 

Consider  memoryless  detectors  of  the  form 


i(g:5) 


i-l  '■ 


where  g is  a memoryless  nonlinearity 
Che  probability  with  which  we  accept 
is  observed;  and  the  randomization  v 
hold  - are  chosen  to  give  desired  error 


(2) 


;(g;x)  is 


H.  when  x 
and  thres- 
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probtblllcy  parfonunce.  Noce  t:hac  Che  class  of 
dececcors  of  cha  form  of  Eq.  (2)  is  sufflclencly 
general  to  contain  oosc  matnoryless  detectors  of 
Interest . 

For  large-sampla-slze  situations,  the  per* 
formance  of  detectors  Is  coomonly  compared  on  the 
basis  of  asymptotic  relative  efficiency  (AEX). 

For  Che  slttiaclon  of  Eq.  (1),  the  asymptotic 
efficiency  of  a detector  relative  to  another 
detector  Is  defined  as  [S] 

ARE(l,2)  • 11m  a(a,9,n)  (3) 

n - » 

9-0 

where  e(at,6,n)  Is  Che  relative  number  of  samples 
^2  requires  to  achieve  the  same  power  (l.a., 
probability  of  correct  detection)  Chat  achieves 
for  sample  size  n when  both  are  operating  at 
false-alarm  probability  a and  the  signal  strength 
Is  9.  In  [ 4 ] , Che  optimum  mestorylass  detector 
Is  considered  to  be  chat  detector  of  the  form  of 
Eq.  (2)  which  Is  Che  oosC  efficient  asymptotically 
In  Che  sense  of  Eq.  (3).  By  considering  a se* 
quence  of  signal  strengths  9 •K/Ja  where  K>  0,  It 
can  be  shomn  under  mild  restrictions  chat  the 
asymptotic  efficiency  of  a detector  9(g^;*)  of 
Che  form  of  Eq.  (2)  relative  to  another  detector 
of  Che  form  of  Eq.  (2)  Is  given  by 
ARE(g..g,)  - Tl(g,>/Tl(g,)  (4) 

where  ^ , , 

T1(g)  - (r  gf')‘‘/ag(g)  (5) 

Is  the  efficacy  of  0(g;');  the  function  f Is  the 
noise  density;  and  the  quantity  (g)  Is  defined 

**  m 

Og(g)-Var(j[g(X^)}  + 2J:^CoVgCg(X^),g(Xj^^)}  . (6) 

Mote  chat  the  subscript  0 denotes  quantities 
computed  under  cha  slgnal*absenC  hypothesis  Hq. 

He  see  from  Eq.  (4)  that  Che  most  efficient 
memoryless  detector  of  cha  form  of  Eq.  (2)  Is 
based  on  a nonlinearity  g^  solving 

gg  • argCmax  Tl  (g))  (7) 

S 

In  [ 4 ] It  Is  shown  under  mild  rastrletlons  Chat 
gg  solves  Eq.  (7)  If,  and  only  If,  gg  (or  some 
constant  multiple  of  gg)  satisfies  Che  Integral 
equation 

8^o(x)  - J K(x.y)8g(y)'ly  • ggCx)  (8) 

for  all  X € (-•,•).  Here  g^^  ^ -f'/f  Is  the  opti- 
mum choice  of  nonlinearity  for  the  problem  In  Eq. 
(1)  when  Cha  noise  process  Is  an  Independent 
sequence  (m>0) ; and  cha  kernel  K(x,y)  Is  given  by 

m 

K(x,y)  - Z [f  (7|x>+f,  .(y|K)]  (9) 

where  f,  , Is  the  conditional  density  of  N,  , 
given  N,  and  vice-versa  for  f . 

^ i # J 

Equation  (8)  Is  a Fredholm  equation  of  the 
second  kind,  and  under  further  mild  conditions. 


the  solution  Is  given  by 

v«0 

where  equality  is  In  the  sense  of  uniform  con- 
vergence. Here  [(p  ;v~0,...,m}  Is  a sequence  of 
functions,  orthogonal  with  respect  to  f, 
satisfying 

• m 

limf  f lK(x.y)/f(y) 

-as 

N , 

- S X ip  (x>p  (y)|  f(x)f(y)dxdyH)  (11) 


X “ f f V (x)qi  (y)K(x,y)f (x)dxdy:  u«0,l,.,.  (12) 
and  ch«  coefficients  c are  given  by 

=v  “ >1'  *fO  ’’v*  = 

If  g Is  another  nonlinearity  In  Che  spen  of 

[p  ; v-0 ■],  then  the  ARE  of  «(gg;>)  to 

p(^:  •)  Is  given  by 

• « ■ - 
ARE(gn,g)-C  S c7(l+X^)].C  Z 0'(1+X  )]/(  Z eSf 


where  8 • f gp  f ; v~0,l Further 

details  of  these  results  can  be  found  In  [4]. 

2.3.  Optimum  Quantization  for  the  Independent 
fm-0>  Case 

In  this  paper  we  will  consider  the  subclass 
of  the  class  of  memoryless  dececcors  of  Eq.  (2) 
for  which  Che  nonlinearity  g Is  an  H-level  quan- 
tizer, chat  Is,  we  consider  the  clast  of  all 
detectors  of  the  form 


: n 

<t(Q;£)  “ < Y : 2 Q(x.)  - t 

I 0 : 


where  Q Is  an  H-level  quantizer;  and  we  wish  to 
choose  Q In  an  optimal  way  for  Che  detection 
problem  of  Eq.  (1).  Note  chat  an  M-level  quan- 
tizer can  be  parameterized  by  a pair  Q e (^,£) 
where  ^•(Cg,Cj^,...  ,c^)  Is  an  ordered  breakpoints 

vector  (-  - tg<  t^<  ...  ^ Vi<  tj,  - 
£ € K Is  a levels  vector;  and  we  take 

Q(’')  - q^  when  X €(tj^_j^,t^  ; k-l,...,M  (16) 

Thus  the  problem  of  optimal  quantizer  design  Is 
one  of  perfonsance  optliaaclon  over  a sec  of 
(2M-1)  real  parasMCers. 

The  problem  of  optimal  quantizer-detector 
design  for  the  Independent  noise  (m>0)  case  of 
Eq.  (1)  has  been  considered  by  Kassam  in  [ 1 ] . 
Specifically  It  Is  shown  In  C 1 ] chat,  for  this 
case.  If  we  fix  the  breakpoints  £ Chen  an  opti- 
mum (asympcoclcally-mosc-eff Iclent)  choice  of 
Che  levels  vector  ^ Is  given  by 
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where  £ Is  Che  univariate  noise  density.  Thus, 

for  each  the  optimum  choice  of  levels  £^°  can 
be  written  In  terms  of  £ and  the  problem  of  choos- 
ing an  optimal  quantizer  Q Is  reduced  to  that  of 
choosing  an  optimal  breakj^lnts  vector  It 

Is  shown  In  [ ] that  the  optimum  £ for  this  case 

(raaO)  must  satisfy 

W4“>  - ^ 0/2  ; k-l.....(M-l)  (18) 

where  Is  from  Eq.  (17)  and  the  function 
- t'/S.  Thus  a simultaneous  solution  to 

Eqs.  (17)  and  (18)  will  yield  the  optlisum  quan- 
tizer parameters  for  the  Independent  noise  case 
of  Eq.  (1).  Further  details  may  be  found  In  [ 1 ] . 

3.  Optimum  Quantization  for  m-Denendent 
Soise 


Icacv  of 
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We  see  from  the  results  suasiiarlzed  In  Sec- 
tion 2 that  Che  optimum  memoryless  nonlinearity 
for  detecting  a constant  signal  In  m-dependent 
noise  CSq.  (1)]  Is  given  by  Eq.  (10).  Similarly, 
the  optimum  quantizer-detector  parameters  for  the 
Independent  noise  case  (maO)  of  Eq.  (1)  are  seen 
to  be  solutions  to  Eqs.  (17)  and  (18).  In  this 
section  we  derive  quantizer  design  equations 
analogous  to  those  Eqs.  (17)  and  (18)  for  the 
general  case  of  m-dependent  noise  using  analysis 
similar  to  that  used  to  derive  Eq.  (10). 

We  consider  the  class  of  mamoryless  quan- 
tizer-detectors d(Q:’)  of  the  form  of  Eq.  (IS). 

As  In  Eq.  (16),  the  quantizer  Q Is  parameterized 
by  Identifying  Q » C£.i)  where  £ and  £ are  the 
breakpoints  and  levels  of  Q,  respectively. 
Adopting  the  optimality  criterion  of  maxismm  ARE, 

we  wish  CO  choose  vectors  and  £*^  so  that  tha 

quantizer  • (£  ,£^)  Is  optimum  for  the  prob- 
lem of  Eq.  (1).  Within  minor  restrictions  (as  In 
r & ]),  the  relative  efficiency  of  one  quantizer- 

detector  if(Q  ;•)  of  the  form  of  Eq.  (15)  relative 

2 

CO  another  quantizer-detector  i2(Q  ;•)  of  the  form 
of  Eq.  (15)  la  given  by 

ARE(Q^q2)  , (19) 

where,  as  In  Eq.  (IS),  the  efficacy  of  9(Q;«) 
is  given  by 

•’(Q)  - (j  (Q),  (20) 

and  defined  by  Eq.  ( S).  Thus  the 

^ 0 
opclfliua  M'-level  quantizer  Q will  Sa  given  by 

Q°  - argC  max  71(q)j  (21) 

06 

where  P Is  the  class  of  all  M-level  quantizers 


(Here  we  must  Introduce  the  restriction  to  chose 
2 

q for  which  > 0.  Without  this  property, 

Eq.  (19)  does  not  hold.  Note  chat  this  is  not  a 
very  restrictive  limitation  since  we  always  have 

2 2 
7^(0)  2 0,  and  Che  case  !Tq(<J)“0  Is  of  limited 

Interest. ) 

Since  q Is  parameterized  by  the  vectors  t 
and  £,  the  efficacy  'n(q)  Is  a function  of  (2M-1) 
real  parameters  (note  that  c^  and  c^  are  fixed) 

so  we  may  write  explicitly  T)(q)  a 'T)(£,£).  Thus 

Eq.  (21)  Is  equivalent  to  finding  q*^  ■ (i*^,£*^) 
with 

Ct°,£®)  - argC  max  Tl(£,£)]  (22) 


Hoce  from  Eq.  (20)  Chat  'n(q)  Is  Invariant  to 
additive  constants,  that  Is  ’KO+S)  • ''l(q)  for 
any  constant  8.  Note  also  chat  £ Is  assumed  to 
be  symmetric;  thus,  we  may,  without  loss  of  gen- 
erality, restrict  our  study  to  chose  quantizers 
q which  have  zero  mean  under  l.e.,  we  re- 
strict q to  satisfy  Eg[q(Xj)}  ■ J qf  • 0. 

It  can  be  shown  that  ’’)(£,£)  Is  given  by 

+ P)a]  (23) 

where  the  superscript  T denotes  transposition. 
Here  the  vector  ^ has  components 

(Af),^  - C£(t^)  - f(tk.l^^=  ‘'■2 (24) 

the  matrix  F • diag{f  . . . .f^^]  where 

f - j “ £(x)dx  ; lc-1 M;  (25) 

"^k-l 

and  Che  M x M matrix  P has  entries 

+ PgCXl€(t^-l,C^]  ,.'Cj_|_i6(Cj^-^,t,_^]3]  : (26) 

k,f-l M 

where  Pq  denotes  probability  under  the  signal- 
absent  bypochasis  Hg.  Recall  chat  f Is  Che  uni- 
variate density,  m Is  th  dependence  paramacar, 
and  M Is  Che  dimension  (l.e.,  number  of  levels) 
of  the  quantizer. 


As  la  Che  Independent  noise  case  of  [ 1 ] , 

It  Is  convenient  to  consider  first  Che  situation 
where  the  breakpoints  vector  £ Is  predetermined 
or  fixed.  Here  we  are  free  to  choose  only  Che 
levels,  and  In  this  case  we  look  for  opclsum 

levels  £ by  searching  for  a solution  £'2  to 
satisfy 

£°  - arg(  max  ’'(£,£)}  (27) 

To  do  so,  we  assume  chat  the  matrix  (F  s-  f)  Is 


F 


positive  definite,  where  F and  P are  from  Eqs. 

(25  and  (26),  respectively*.  Within  this  restric- 
tion, a necessary  condition  for  a solution  to  Eq. 
(27)  Is  chat 

grad  T|(^,3;j  „ ” 0 (28) 

1 a-a“ 

This  leads  to  the  condition 

(M)  + (I+f)a°  - 0 (29) 

where  f , and  g are  defined  by  Eqs.  (24) 
through  (26).  [Note  chat  the  dependence  on  ^ of 
4f . F,  S and  3.®  Is  Implicit  In  Eq.  (29).]  Equa- 
tion (29)  can  also  be  shown  to  be  a sufficient 
condition  for  3,®  to  solve  Eq.  (27). 

Since  the  noise  density  f Is  assumed  to  have 
support  (-•,•),  the  terns  (fj^,. . . ,fj^)  on  Che  diag- 
onal of  the  matrix  F are  all  positive.  Thus,  F Is 
Invertible  and  Eq.  (29)  can  be  rewritten  In  a 
more  Intuitively  appealing  forms 


lo  _ 0 

1 * K a 


where  the  M x M matrix  K 

■Sc.! 


F S has  entries 
k,/»l, . . . ,M 


(30) 

(31) 


and  P.  and  f.  are  from  Eqs.  (2S)  and  (26),  and 
2o*  -1 

Che  vector  3 • F (^)  has  components 

'^k-l 

h-l M (32) 

Is  the  optimum  cholse  of  levels  for  the  Indepen- 
dent noise  (m-0)  case  from  Eq.  (17).  Comparing  Eq. 
(30)  to  the  Integral  equation  Csq.  (8)]  of  Sec- 
tion 2,  we  see  the  analogy  between  the  quantized 
(fixed-breakpoints)  case  and  Che  continuous 
nonlinearity  case. 


The  positive  definiteness  of  (F-tf)  Implies 
that  (I+K)  Is  Invertible  (J  Is  the  M x M Identity 
matrix).  Thus  we  have  the  solution 


could  be  derived  by  applying  Che  Schwarz  In- 
equality to  Che  efficacy  '')(Q).  The  approach  here 
Is  used  because  of  Che  analogy  to  chat  for  the 
continuous  nonlinearity  case. 

Even  If  (F-hf)  Is  not  positive  definite,  Eq. 
(30)  still  has  a solution  given  by 


lo 

i 


- K(i  + j:) V“ 


(36) 


where  the  superscript  -f  denotes  Che  generalized 
Inverse.  Equation  (36)  can  be  verified  by  direct 
substitution  Into  Eq.  (30)  If  we  note  chat  Che 
matrix  ( I+f^)  CJ+f )■*■  Is  the  projection  onto  Che 
range  space  of  (I+K).  Note  however  chat.  If  (F-*J) 
Is  not  positive  definite,  Chen  the  necessity  of 
Eq.  (23)  Is  not  assured  and  Che  expression  of  Eq. 
(19)  cannot  be  used  for  all  quantizers  Q.  [Since 
2 

Oq(Q)  will  equal  zero  for  soma  Q.] 


3.3.  Results  for  Fixed  Braakoolnts-Ef f Icacv 
Expressions 

The  efficacy  T|(Q)  a T)(t,3)  of  a quantizer- 
detector  $(Q;*)  can  be  computed  from  Eq.  (23). 
For  fixed  3,  71(3,3)  I*  maximized  ^en  3 « 3®, 

Che  solution  from  Eq.  (33).  Combining  Eqs.  (23) 
and  (33)  we  have  chat,  since  (F+P)  Is  Invertible, 


op  T!(l,a)  - - (M)^Cf'-^r\df)  (37) 

For  Che  Independent  noise  (m>0)  case,  we  have 
P > 0,  and  Eq.  (36)  reduces  to 

Tl(i.a°)"(M)’^F"V^ 


C[f(t^,.^)-f(t|^)]v,r  ^ f(x)dx] 

which  agrees  with  previously  established  results 
for  this  case  [ I ] . 


The  asymptotic  efficiency  of  Che  quantizer- 
detector  using  Q®“(3,3®)  relative  to  a quantizer- 
detector  using  Q~(3,^  Is  given  by  the  ratio  of 
their  efficacies 


Cl  + K)* 


Using  Che  Identity 

a + K) 

Eq.  (33)  becomes^ 


-1 


I - K(r.+  K) 


-I 


3-  - K(I  + K)‘V° 


(33) 

(34) 

(35) 


%ite  chat  Eq.  (35)  Is  directly  analogous  to 
the  continuous  nonlinearity  solution  given  by  Eq. 
(10)  of  Subsection  2.2.  Note  also  chat  Eq.  (35) 

•It  Is  easily  shown  that,  with  Q*(3,3)  and  ^Qf^O, 

"•  <Jg(q)  - 0 

where  F and  P are  from  Eqs.  (25)  and  (26)  respec- 
tively. Thus  the  matrix  (F+P)  Is  at  least  non- 
negative  definite,  ^oce  furc^ier  chat  If  the  ker- 
nel K(x,y)  from  Eq.  (7)  Is  a positive  definite 
kernel,  Chen  (F+P)  will  be  positive  definite 
for  all  3.  This  latter  case  holds,  for  example, 
for  Gaussian  noise  processes. 


ARE(Q“,Q)  - ll(t,3'')/T,(3,3) 


(38) 


Again  since  3 Is  such  that  (F+P)  Is  Invertible, 
Eqs.  (23),  (37)  and  (38)  Imply  Chat 

n [(M)^(F-t?)'^M)lCa'’^(F+f)i! 
ARE(Q^,Q)  • (39) 

C (Ai ) a] 

0 

specifically,  Che  Improvananc  gained  by  uaiog  ^ 


-F'^3f) 


over  Che  Independenc-nolse  levels  3 

lj(  M)’^(*'+P)‘  V4f)I(M)^*V+I9F  \4f)3 

ARE(Q°.Q^  )- 


[(Af)'’^F'‘-(M)]^ 


(40) 


If  Che  breakpoints  3 are  chosen  so  chat 
they  partition  Che  real  line  Into  equlprobabll- 

Ity  segments  (under  Hg),  Chen  F-Jl,  and  we  have 


4 


ARE(Q°.Q^°)1 


( I+K)  Vif)  ] [(if  f ( J+K)  Qf  ) ] 


i%qul 


Now  that  Eq.  (41)  Implies  that,  for  f 


(41) 


^ ^max) 
^ ^«in) 


a AW!(q‘^.Q^“)| 


a .1243- 

(!•  + X ) 
' siax' 


(42) 


t»t  , 

— -^qul 

where  X is  the  maximum  eigenvalue  of  K and 

fflaX  ■■ 

^min  mlnitniffl  eigenvalue  of  X.  [Note  that 

the  right-hand  side  of  Eq,  (42)  is  trivially  true 
since  we  have  by  definition  of  that 

ARE(Q°.Q^°)  a I a (1  + X^^)/(l  + X^)] . 


3.4,  Choosing  Ootlmum  Breakpoints 

Ue  turn  now  to  the  problem  of  choosing  an 
optimal  set  of  breakpoints  An  overall  optimum 

choice  of  quantizer  >3^)  will  be  one  for 

which  'h(^,a,)  is  a maximum  over  all  possible 
choices  of  t and  From  the  results  of  Subsec- 
tion 3.2  we  have  that,  for  fixed  the  optimal 
choice  of  levels  is  made  by  choosing  3,^  from  Eq. 
(33)  corresponding  to  Writing  explicitly 

CO  emphasize  the  dependence  on  c of  the 
solution  from  Eq.  (33),  we  have 

max  TlCc.a)  • ■n(t,i*^(t)).  (43) 

a 

Thus,  as  in  the  independent  noise  case  of  Subsec- 
tion 2.3,  the  problem  of  maximizing  'n(^,^  over 
(a>a)  <=‘0  be  reduced  to  that  of  maximizing 

’I (^,a_*^(£) ) over  jt;  that  is,  we  look  for  ^ to 
solve 

t°  - arg[max  Tl(l,a*^(4))] 
and  the  overall  optimal  quantizer  will  be  given 
by  Q°  » (C°,a°(c)). 

To  look  for  solutions  to  Eq.  (44),  we  re- 
strict t.he  noise  process  to  be  such  that  the 
matrix  (F-ff)  is  positive  definite  for  every 
choice  of  t.  For  this  case,  we  have  from  Eq. 

(37)  chat  ” 

^(i.a°(t))  - (4f)‘'(f  + P)*\4£)  (45) 

A necessary  condition  for  ^ to  maximize  (45)  is 
chat 

grad  Tl(c,a°(t))|  -0  (46) 

c 

Using  the  identity 

!>(Z+?)'V5'tj^  - (F+|)*^Ciq+P)/5c^](F+P)’^  , 

Eq.  (49)  can  be  shown  to  hold  if 

£^0  (e°)  • h (47) 

where  the  vector  £^0  *lo^^M-l^^^’ 


the  function  g^^— f'/f;  and  the  (M-l)XM  matrix 
L has  entries 


for  k»l (m-l)  and  f"l,...,M  , 

Here  6 . is  the  Kronacker  delta  and  Che  matrix 
g is  frdft  Eq.  (26). 


Thus,  combining  Eqs.  (33)  a^  (47),  an  ovse- 
all  optimal  quantizer  > (£^ia^)  will  be  a 


soluclon  CO  ch«  tquacloas 

0 0 
i a 

(49) 

Ahd  „ , , 

a°  • 

(50) 

where  the  quantities  3,  , K and  ^ are  cosipuCed 

for  1 from  Eqs.  (31)  - (33)  and  (48).  That 
is,  under  Che  above  assumptions,  Eqs.  (49)  and 
(50)  are  necessary  conditions  chat  must  be  sat- 
isfied by  an  optimum  (most-efficient)  quantizer 
for  a mesioryless  decision  between  Che  hypothe- 
sis pair  of  Eq.  (1).  Given  that  is  optimal 
and  (F-tJ)  is  positive  definite,  Eq.  (50)  is  suf- 
ficient for  3^*^  CO  be  optimal;  however,  the  suf- 
ficiency of  Eq.  (49)  can  be  dacermlnsd  analyti- 
cally only  for  special  cases,  and  a nuMrical 
test  must  be  used  in  the  general  case. 


Note  chat  for  the  independent-noise  (m-0) 
case,  Che  entries  of  the  matrix  L become 


^k,Z 


[8 


k,Z 


+ 5 


k+1 


k-l (M-l 


and  Che  matrix  g is  identically  zero.  Thus,  for 
this  case,  Eqs.  (49)  and  (50)  reduce  to  Eqs. 

(17)  and  (18)  so  chat  Eqs.  (49)  and  (SO)  agree 
with  Che  previously  established  results  for 
this  case. 


4.  Example  - 4-Laval  Quantization 
Example  1 - Gaussian  Noise 

To  illustrate  Che  results  of  Section  3,  we 
consider  the  particular  problem  of  designing  4- 
level  quantizers  (M^)  for  use  in  detecting 
known  signals  in  m-dapendenc  Gaussian  noise. 

Specifically,  we  assume  chat  the  noise  pro- 
cess [Nj^;  i>l, . . . ,n}  of  Eq.  (1)  arises  from  uni- 
form sampling  of  a stationary  Gaussian  process 
N(c).  We  assume  chat  N(c)  has  zero  mean  unit 
variance,  and  autocorrelation  s(T)^[N(t)M(c+’')3 
given  by  / 

I (1  - |t|/0)  ; |t|  S 0 

P(T)  - < (51) 

\ 0 ; |t!  >D 

where  D > 3.  The  samples  arc  taken  at  intervals 
of  length  D/(<iH.l),  and,  at  this  sampling  race, 
[Nj^:  l«l, . . . ,«}  is  m-dependanc.  For  this  case, 

the  elements  of  Che  matrix  jC  of  Eq.  (31)  art 
given  by 


5 


I 

\ 

I 

I 

r 


t.  . c. 


k-l  Z-l 


(52) 


whart  w(x,7;c)  Is  Che  btvarlace  density  funcclon 
of  cwo  scandard  Jolncly  Caussian  randon  variables 
with  correlacion  coefficient  p ; f is  Che  Gaussian 
distribution  function;  and 

Pj- 0(JD/(sh-1))  - (l-j/(aH-l))  ; J-l > (53) 

Bare,  Che  opcinuo  quantizer  for 

the  case  H"4  (l.e.,  4-level  quantization)  is  char- 
acterized by 


and 


-0  -0 
-*0  ■ '4  ■ 


tj.t0>0 


(54) 


Since  )](Q>  is  independent  of  scale  (i.e.,  IKoQ)' 
'n(Q)  for  |a|  ^ 0),  we  aay  thus  characterize 

eoaplecely  by  specifying  the  upper  breakpoint  c^ 
and  Che  levels  ratio  (q^/q^).  Table  I gives 

values  of  these  parameters  for  several  values  of 
Che  dependence  parameter  m.  Hote  that  mvO  gives 
Che  independent  case.  Also  given  in  Table  I are 

values  of  ARE(Q°,()^“)  and  4Il£(Q°,i  .d. ) where 
denotes  the  m>0  quantizer  and  't.d.'  denotes  the 
linear  detector  (i.e.,  Eq.  (2)  with  g(x)  a x) 
which  is  Che  optimum  memoryless  detector  for  this 
r 1 0 

ease  L4J  4RZ(Q  ,Qfo)  is  a measure  of  the  iaprove- 

■ent  gained  by  these  techniques  over  chat  system 
designed  by  merely  ignoring  the  dependence, and 
0 

ABE(Q  ,X.d.)  is  a measure  of  the  degradation  in 
performance  due  to  quantization. 

Example  2 - Cauchv  Hoise 

As  a second  example  consider  the  noise 

process  )}".^  where 

T(z)  “ tan(TTerf (z/v7)/2)  and  I*  • Gaussian 

process  identical-  to  the  process  of  Ex- 

ample 1.  This  will  yield  a Cauchy  noise  process 
with  univariate  density  f(x)«{n(l-M  )]  . The  op- 

cimum  4-level  quantizer  for  will  also 

satisfy  gq.  (54)  and  its  parameters  are  given  in 
Table  II.  Note  chat,  here,  there  are  two  equiva- 
lent optimal  quantizers  for  Che  mwO  ease.  These 

are  denoted  by  (rf®  and  (rf®,  raspecclvaly,  and  per- 
0 ^ ‘ 

formance  of  Q relative  to  each  of  these  is  given 
in  Table  II. 

Note  chat  q^  < 0 for  some  values  of  a,  this 
is  eons is cent  with  results  for  Che  unquanclzed 
megx>rvless  case  for  this  example  as  discussed 
in  [4^. 
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Table  I.  4-Level  Quantizer  Parameters 
for  Gaussian  Noise 


■ 

(94/93) 

ARE(Q°.(5^®) 

AllE(Q°,X.d.) 

0 

0.982 

3.34 

1.00 

.882 

1 

1.03 

3.40 

1.000 

.935 

2 

1.09 

3.46 

1.002 

.953 

5 

1.19 

3.44 

1.005 

.972 

10 

1.24 

3.40 

1.006 

.981 

15 

1.26 

3.38 

1.007 

.983 

25 

1.27 

3.38 

1.007 

.986 

Table  II.  4-Level  Quantizer  Parameters 
for  a Cauchv  Noise  Process 


■ 

0 

•=3 

(94%;) 

ARE(Q°.q{®) 

ARE(Q°.Q^®) 

“l 

0.254 

2.92 

1.00 

1.00 

°2 

3.94 

.342 

l.OO 

1.00 

1 

3.94 

-.238 

2.53 

2.14 

2 

2.13 

-.0802 

2.90 

2.31 

5 

2.12 

-.237 

3.50 

2.63 

10 

1.88 

-.227 

3.81 

2.80 
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